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ROBUSTNESS  IN  THE  PRESENCE  OF  MIXED  PARAMETRIC 
UNCERTAINTY  AND  UNMODELED  DYNAMICS 


Michael  K.H.  Fanf  Andre  L.  TitsJ  John  C.  Doyle* 

Abstract 

It  is  shown  that,  in  the  case  of  mixed  real  parametric  and  complex  uncertainty,  the 
structured  singular  value  can  be  obtained  as  the  solution  of  a  smooth  constrained  opti¬ 
mization  problem.  While  this  problem  may  have  local  maxima,  an  improved  computable 
upper  bound  to  the  structured  singular  value  is  derived,  leading  to  a  sufficient  condition 
for  robust  stability  and  performance. 

0.  Introduction 

An  inherent  tradeoff  in  modeling  is  between  fidelity  and  simplicity.  It  is  desirable  to 
have  models  which  closely  match  reality,  yet  are  still  easy  to  analyze.  This  tradeoff  arises  in 
modeling  uncertainty.  For  example,  a  single  norm-bounded  perturbation  simplifies  analysis 
but  may  be  too  conservative.  Introducing  more  structure  may  improve  the  model  fidelity 
but  typically  complicates  the  analysis.  It  is  often  very  natural  to  model  uncertainty  with 
real  perturbations  when,  for  example,  the  real  coefficients  of  a  differential  equation  model 
are  uncertain.  It  is  important,  however,  to  remember  that  such  parametric  variations 
are  in  a  model,  not  in  the  physical  system  being  modeled.  Models  with  real  parametric 
uncertainty  are  used  because,  in  principle,  they  allow  more  accurate  representation  of  some 
systems. 

The  structured  singular  value  (SSV  or  ji)  was  introduced  to  study  structured  uncer¬ 
tainty  in  linear  models  [1-3].  It  is  defined  in  such  a  way  as  to  give  a  precise  characterization 
of  robust  stability  and  performance,  in  an  sense,  for  a  rich  variety  of  uncertainty  de¬ 
scriptions  (Small  /j,  Theorem  [2]).  There  is  a  large  literature  on  robustness,  particularly 

|  Michael  K.H.  Fan  was  with  the  University  of  Maryland.  He  is  now  with  the  School 

of  Electrical  Engineering,  Georgia  Institute  of  Technology,  Atlanta,  Georgia  30332-0250 
+  Andre  L.  Tits  is  with  the  Electrical  Engineering  Department  and  Systems  Research 

Center,  University  of  Maryland,  College  Park,  MD  20742 

*  John  C.  Doyle  is  with  the  Electrical  Engineering  Department,  California  Institute  of 

Technology,  Pasadena,  CA  91125 


1 


for  unstructured  uncertainty,  and  connections  with  H ^  theory.  A  brief  historical  review  of 
the  literature  most  directly  influencing  the  development  of  //-based  methods  will  be  given 
after  the  notation  is  introduced. 

Much  of  the  subsequent  research  on  //  has  focused  on  computational  schemes,  with 
reasonable  success  for  problems  involving  only  complex  uncertainty.  Complex  perturba¬ 
tions  are  typically  used  to  represent  uncertainty  due  to  unmodeled  dynamics,  or  to  “cover” 
the  variations  produced  by  several  real  parameters.  In  the  //  framework,  complex  uncer¬ 
tain  blocks  also  arise  for  problems  of  robust  performance,  and  thus  practical  applications 
of  /t  always  involve  at  least  one  complex  block.  Although  there  are  important  outstanding 
issues  to  be  resolved  in  computation  of  fi  for  complex  perturbations,  substantial  progress 
has  been  made  and  //  is  being  applied  routinely  to  large  engineering  problems.  This  paper 
focuses  on  computation  of  //  for  mixed  real  parametric  and  complex  uncertainty,  which  is 
fundamentally  more  difficult  than  for  complex  perturbations. 

The  major  issues  in  computing  //,  or  its  equivalent,  are  the  generality  of  the  problem 
description,  the  exactness  of  analysis,  and  the  ease  of  computation.  Existing  methods  for 
real  perturbations  emphasize  just  two  of  these  three  issues.  A  general  and,  in  principle, 
exact  method  is  a  brute  force  global  search  using  a  grid  of  parameter  values  (e.g.  [4, 
5]).  This  inevitably  involves  an  exponential  growth  in  computation  as  a  function  of  the 
number  of  parameters,  and  taking  fewer  grid  points  to  avoid  this  gives  up  exactness.  This 
“exponential  explosion”  limits  the  usefulness  of  exhaustive  global  search  methods,  although 
simple  search  in  some  form  will  always  play  an  important  role  in  practical  control  design. 

Tentatively,  a  reasonable  requirement  on  a  computational  scheme  would  seem  to  be 
that  the  typical  time  to  compute  solutions  scales  in  some  polynomial  way  with  the  size 
of  the  problem.  This  is  compatible  with  the  conventional  view  in  computational  linear 
algebra,  where,  for  example,  the  QZ  iteration  for  computing  singular  values  is  considered 
an  acceptable  approach.  From  this  point  of  view,  progress  is  being  made  in  reducing 
the  computational  burden  of  exact  methods  [6-8],  but  no  general,  exact,  polynomial¬ 
time  algorithms  are  available.  Nevertheless,  this  work  suggests  some  promising  research 
directions,  and  these  will  be  discussed  in  the  final  section. 

An  approach  to  obtaining  exact  results  with  more  modest  computation  is  to  restrict 
the  problem  description.  The  best  example  is  Kharitonov’s  celebrated  result  for  polyno¬ 
mials  with  coefficients  in  intervals  [9].  While  few  models  with  engineering  motivation  fit 
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the  allowable  problem  description,  Kharitonov’s  theorem  inspired  a  great  deal  of  research. 
Progress  is  being  made  in  this  direction  by  allowing  more  general  uncertainty  descriptions 
at  the  expense  of  more  computation  (e.g.  [10-12]).  Unfortunately,  the  results  so  far  indi¬ 
cate  that  even  modest  departure  from  the  interval  polynomial  problem  leads  to  exponential 
explosion. 

The  approach  taken  in  this  paper  could  be  characterized  as  being  very  general  and 
computationally  attractive,  but  potentially  inexact.  Following  the  methods  developed  for 
H  in  the  case  of  complex  perturbations,  the  main  idea  is  to  get  upper  and  lower  bounds 
using  local  search  methods  which  are  computationally  inexpensive,  but  may  fail  to  find 
global  solutions.  One  then  seeks  to  prove  that  the  local  methods  yield  global  solutions, 
or  that  the  bounds  one  gets  are  tight  enough  to  be  of  value  in  problems  of  interest.  The 
strategy  taken  in  this  paper  has  been  very  successful  in  the  case  when  all  perturbations 
are  complex  and  appears  to  have  promise  for  the  general  case  as  well,  although  it  is  clear 
that  the  latter  is  much  more  challenging.  In  the  final  section,  some  speculations  will  be 
presented  on  how  the  results  in  this  paper  might  be  combined  with  the  work  in  [6-8]  to 
obtain  an  approach  which  is  general,  efficient,  and  exact. 

The  balance  of  the  paper  is  organized  as  follows.  In  Section  1,  the  SSV  framework  is 
introduced  and  a  brief  historical  review  of  the  literature  most  influencing  the  development 
of  p-based  methods  is  given.  In  Section  2,  it  is  shown  that  /i  can  be  obtained  as  the 
optimal  value  of  a  smooth  constrained  optimization  problem.  Geometric  interpretation  of 
this  result  is  discussed  in  Section  3.  The  framework  of  Sections  2  and  3  is  used  in  Section  4 
to  derive  a  new  computable  upper  bound  on  /i.  In  Section  5  the  new  bound  is  shown  to 
be  mathematically  equivalent  to  that  given  in  [3]  for  the  case  of  nonrepeated  real  scalar 
blocks.  A  serious  and  valid  criticism  of  the  literature  on  fj,  is  the  lack  of  tutorial  material, 
thus  limiting  the  readership  primarily  to  experts.  While  it  is  beyond  the  scope  of  this 
paper  to  correct  this  deficiency,  Section  6  contains  some  simple  examples  and  numerical 
experiments  which  should  both  motivate  and  illustrate  the  use  of  the  theory.  Also,  the 
next  section  give  some  historical  background.  Finally,  Section  7  offers  some  speculation 
about  the  future  directions  for  research  in  this  area.  All  proofs  are  given  in  Appendix  A. 
Appendix  B  contains  data  used  in  the  experiments  of  Section  6. 

Many  of  the  results  of  this  paper  have  appeared,  without  proof,  in  [13]. 
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1.  Preliminaries 


1.1.  Framework 

Throughout  the  paper,  given  any  square  complex  matrix  M ,  we  denote  by  <f(M)  its 
largest  singular  value,  by  cr(M)  its  smallest  singular  value,  by  M  its  complex  conjugate 
and  by  MH  its  complex  conjugate  transpose,  and  we  let  pr(M)  =  max{|A|  :  A  is  a  real 
eigenvalue  of  M},  with  pn(M)  =  0  if  M  has  no  real  eigenvalue.  If  M  is  Hermitian,  we 
denote  by  A (M)  its  largest  eigenvalue.  Given  any  complex  vector  x,  xH  indicates  its 
complex  conjugate  transpose  and  ||x||  its  Euclidean  norm.  The  empty  set  will  be  denoted 
by  0.  Finally,  while  j  (italics)  will  be  used  as  a  running  index,  j  (slanted)  will  denote  \f—\. 

Given  an  n  x  n  complex  matrix  M  and  three  nonnegative  integers  mr,  mc,  and  me, 
with  m  :=  mr  +  mc  +  me  <  n,  a  block  structure  )C  of  dimensions  (mr,mc,mc)  associated 
■with  M  is  an  m-tuple  of  positive  integers 


h,  —  (&!,•••,  kmr  ;  &mr-f  1 ,  •  •  •  ,  ^mr  +  mc  i  &mr  +  mc  + 1 ,  •  •  •  ,  &m) 


(1.1) 


such  that  Yh  kq  —  n.  Given  a  block  structure  /C,  consider  the  family  of  block  diagonal 
1= i 

n  x  n  matrices 


XK  =  {block  diag(«TA,  Af, . . . ,  A®  )  : 


Sg  Eft,  6g  6  C,  €  IC^r+mc  +  gXlCmr+me  +  g^ 


where  for  any  integer  k,  denotes  the  k  x  k  identity  matrix.  The  ‘repeated  real  scalar’ 
blocks  bglkq  correspond  to  parametric  uncertainty,  one  ‘repeated  complex  scalar’  block 
6glkrnr+q  can  be  used  to  represent  frequency  (see  [3]  for  details;  several  blocks  of  the  latter 
type  are  introduced  here  mostly  for  the  sake  of  uniformity)  and  the  ‘full  complex’  blocks 
Ag  correspond  to  unmodeled  dynamics.2 

Definition  l.l.[l]The  structured  singular  value  pic(M)  of  a  complex  n  x  n  matrix  M  with 
respect  to  block-structure  K  is  0  if  there  is  no  A  in  Xk,  such  that  det(I  —  AM)  =  0,  and 

(  min  {cr(A)  :  det(I  —  AM)  =  0}^)  (1.2) 

J 

2  Note  that  non-repeated  complex  scalars  6C  can  be  viewed  indifferently  as  repeated 
complex  scalar  blocks  6cIk,  with  k  =  1,  or  as  full  complex  blocks  Ac  £  <Dlxl. 
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otherwise.  □ 

Directly  from  Definition  1.1,  it  is  easily  shown  that 


Pr(M)  <  ixk(M)  <a(M)  (1.3) 

and  that,  for  any  U,V  E  fbc,  D  E  Xbc, 

Hk(M)  =  nK{DUMVD -1)  (1.4) 


where 

UK  =  {U  E  XK  :  UUH  =  /} 

and 

VK  =  {block>diag(Di,...,Dmr+me,diJfcrar+me+l,...,dmcIfcm)  : 

0  <  Dq  =  e  >  0}. 

Combining  these  two  sharpens  (1.3)  to3 

max  pr(MU)  <  pic(M)  <  inf  a(DMD_1)  .  (1.5) 

U&Uk.  D£Vk: 

For  the  purely  complex  case  (mr  =  0),  the  pr  inequality  is  always  an  equality  and 
the  <7  inequality  is  an  equality  when  2 mc  +  me  <  3  [1,14].  The  pr  expression  typically 
has  nonglobal  local  maxima  while  every  local  minimum  of  the  a  expression  is  global. 
Extensive  computational  experience  has  suggested  that  it  is  easy  to  obtain  U  E  Uk,  making 
Pr(MU)  close  to  the  latter,  even  when  me  1.  These  bounds  formed  the  basis  for  early 
computational  approaches  to  //  for  mr  =  0,  because  local  search  methods  could  be  used  to 
make  the  bounds  reasonably  tight  [1,15,16]. 

Unfortunately,  when  mr> 0  the  bounds  in  (1.5)  may  be  arbitrarily  far  off,  even  for 
problems  with  engineering  motivation.  In  [3]  an  improved  upper  bound  was  obtained  but 
no  practical  way  to  compute  it  was  given.  This  paper  provides  an  alternative  maximization 
to  the  pr  expression  which  is  equal  to  p/c (M)  at  its  global  maximum.  The  new  expression 
suggests  a  geometric  interpretation  based  on  the  concept  of  ‘multiform  numerical  range’. 
Also,  an  upper  bound  mathematically  equivalent  to  the  one  in  [3]  is  obtained,  but  with 
much  better  computational  properties. 

3  Note  that,  if  mr  =  0,  pR  can  be  equivalently  replaced  by  the  spectral  radius  p. 
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1.2.  Historical  Perspective 

In  this  section,  we  will  briefly  review  the  ideas  that  most  influenced  the  original 
development  of  the  theory.  These  remarks  are  essentially  from  earlier  papers  [1,2],  but 
are  repeated  here  for  the  convenience  of  the  reader. 

An  obvious  influence  was  the  work  in  so-called  Robust  Multivariable  Control  Systems 
from  the  late  1970s  (see,  for  example,  [17])  which  in  turn  drew  heavily  on  earlier  work 
in  stability  analysis  (  e.g.  [18-22]),  particularly  small  gain  and  circle  theorems.  These 
theorems  established  sufficient  conditions  for  stability  of  nonlinear  components  connected 
in  feedback.  The  emphasis  in  the  robustness  work  was  on  small  gain  type  conditions 
involving  singular  values  that  were  both  necessary  and  sufficient  for  stability  of  sets  of 
linear  systems  involving  a  single  norm  bounded  but  otherwise  unconstrained  perturbation. 
Another  emphasis  for  much  of  the  robustness  theory  was  on  using  singular  value  plots  to 
generalize  Bode  magnitude  plots  to  multivariable  systems. 

While  methods  based  on  singular  values  were  gaining  in  popularity,  it  became  evident 
that  their  assumption  of  unstructured  uncertainty  was  too  crude  for  many  applications. 
Furthermore,  the  problem  of  robust  performance  was  not  adequately  treated.  Freudenberg 
et  al.  [23]  studied  these  issues  using  differential  sensitivity  and  suggested  that  something 
more  than  singular  values  was  needed.  It  was  a  natural  step  to  introduce  structured 
uncertainty  of  the  type  considered  in  this  paper  (see  [24]  for  an  early  treatment).  The 
so-called  conservativeness  of  singular  values  rested  in  the  fact  that  the  bounds  in  (1.3) 
could  be  arbitrarily  far  off,  and  research  was  begun  to  provide  improved  estimates  of  p, 
with  an  initial  focus  on  the  nonrepeated,  complex  case  (mr  =  mc  =  0). 

It  was  obvious  that  the  sharper  bounds  in  (1.5)  could  help  alleviate  the  conservative¬ 
ness  somewhat.  These  bounds  were  similar  to  the  multiplier  methods  that  were  used  in 
nonlinear  stability  analysis  to  reduce  the  conservativeness  of  small  gain  type  methods  [21], 
but  the  use  of  both  upper  and  lower  bounds,  and  the  questions  of  how  close  the  bounds 
were  and  how  to  efficiently  compute  them  were  new  and  open.  That  the  lower  bound  is 
equal  to  fi  is  relatively  straightforward  and  not  surprising.  What  is  remarkable,  even  in 
retrospect,  is  that  the  upper  bound  is  also  an  equality  for  me  <  3  and  close  for  me  >  4. 
The  equality  results  were  first  proven  in  [1],  while  the  me  >  4  case  has  only  experimen¬ 
tal  evidence.  Although  by  now  that  evidence  is  extensive,  it  remains  an  important  open 
question  to  further  characterize  the  exact  nature  of  the  upper  bound  for  me  >  4. 
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There  was  substantial  numerical  evidence  for  the  upper  bound  results  some  time  before 
they  were  proven.  Engineers  at  Honeywell’s  Systems  and  Research  Center,  particularly  Joe 
Wall,  began  routinely  using  a  simple  generalization  of  Osborne’s  routine  [25]  to  approxi¬ 
mate  the  upper  bound  in  (1.5)  and  gradient  search  to  find  a  local  maximum  for  the  lower 
bound.  Osborne’s  algorithm  minimizes  the  Frobenius  norm  rather  than  the  maximum 
singular  value,  and  the  scalings  produced  can  be  used  to  approximate  the  upper  bound. 
The  consistent  closeness  of  the  bounds,  usually  within  a  few  percent,  suggested  that  there 
was  a  deeper  connection  between  the  bounds.  Ironically,  minimizing  the  Frobenius  norm 
remains  the  cheapest  method  of  approximating  the  upper  bound.  Safonov  [26]  suggested 
a  somewhat  less  general  approximation  to  the  upper  bound  based  on  Perron  eigenvectors 
which  is  comparable  to  Osborne’s  in  speed  and  accuracy. 

While  the  p  framework  arises  naturally  in  studying  robust  stability  with  structured 
uncertainty,  it  also  can  be  used  directly  to  treat  the  problem  of  robust  performance  with 
structured  uncertainty  [2].  This  is  a  consequence  of  the  intimate  connection  between  (i 
and  linear  fractional  transformations  (LFT)  [3,14],  In  retrospect,  it  is  clear  that  Redheffer 
had  developed  the  foundation  of  this  connection  in  his  work  on  LFT  in  the  late  1950’s  [27, 
28].  In  fact,  Redheffer  had  even  proven  that  the  upper  bound  in  (1.5)  was  an  equality  for 
the  case  where  mr  —  mc  =  0  and  me  =  2.  While  Redheffer’s  results  were  not  well  known 
in  the  control  community  until  the  /r  theory  was  already  well  developed,  the  rediscovery 
of  his  work  has  since  had  an  important  influence,  not  only  on  the  further  development  of 
fi  but  in  other  areas  as  well  (e.g.  see  [29]). 

2.  A  Smooth  Optimization  Problem 

Definition  1.1  suggests  that  one  consider  matrices  A  6  A/c  such  that,  for  some 
nonzero  x 

A Mx  =  x  .  (2-1) 

Without  loss  of  generality,  x  has  unit  length,  i.e., 

x  €  dB  :=  {x  G  C"  :  ||z||  =  1). 

In  view  of  the  structure  of  A,  (2.1)  imposes  some  constraints  on  ‘subvectors’  of  x,  corre¬ 
sponding  to  x  being  split  according  to  structure  )C.  To  help  the  reader’s  intuition,  we  first 
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consider  the  case  of  uncertainty  consisting  of  a  single,  possibly  repeated,  uncertain  real 
parameter  and  a  single  complex  block. 

2.1.  Key  Ideas  in  a  Special  Case 

As  a  simple  special  case,  consider  the  block  structure 

tc  =  ( kr ; ;  kc)  (2.2) 

and  the  corresponding  family  of  matrices 

XK  =  {block  diag  (6rIkr ,  Ac)  :  6r  E  E,  Ac  6  C*c  x kc  }  . 

Let  Qr  6  E krXn,Qc  6  EfccXn  be  projection  matrices  defined  by 

Qr  =  [hrOl  Qc  =  [Q  hc]  ■ 

The  constraints  on  x  implied  by  (2.1)  are 

6rQrMx  =  QrX  (2.3) 

A cQcMx  =  Qcx  .  (2.4) 


In  order  for  (2.4)  to  be  achieved  for  some  Ac,  u-(Ac)  <  b,  for  given  b  >  0,  it  is  necessary 
and  sufficient  that 

b\\QcMx\\  >  \\Qcx\\  . 

Similarly,  for  (2.3)  to  be  achieved  for  some  |£'r(  <  b,  it  is  necessary  (but  no  more  sufficient) 
that 

b\\QrMx\\  >  II Qrx\\  (2.5) 

Equation  (2.1)  now  implies  additional  constraints,  namely  (if  aq  ^  0,  i  =  1, . . .  ,  kr ) 


(Mx)t  _  (Mx)j 

—  _  ,  —  i, . . . ,  /tj- 


Xi 


Xj 


(2.6) 


(including  the  case  i  =  j ),  as  these  are  equivalent  to  the  existence  of  (  (E  E  such  that 


C(Mx)i  =  X{ ,  *  =  1, . . . ,  kr 
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Thus  fiic(M)  =  b*1 ,  with  K  the  smallest  b  for  which  some  x  exists  that  satisfies  all  these 
constraints.  Letting  9  =  6_1  and  removing  the  assumption  that  x  has  nonzero  components, 
one  obtains  the  following  results  for  structure  (2.2),  a  special  case  of  Theorem  2.1  below: 


0  if  Sk(M)  =  0 

max{0  :  ||QrMa:||  >  0||<3ra;||,  \\QcMx\\  >  0\\Qcx\\  for  somes  E  Sk{M)}  otherwise. 


with 


Sk{M )  =  {x  E  dB  :  Xj(Mx)i  =  xi(Mx)j ,  i,j  =  1, . . . ,  &r}  .  (mr  =  me  =  1,  rnc  =  0) 


Note  that  the  constraint 


Xj{Mx)i  —  Xi(Mx)j ,  i,j  —  1, . . . ,  kr 


can  be  equivalently  expressed  as 

xHMHEtjx  =  xHEijMx  ij  =  1, ... ,  kr 

where  E is  any  n  x  n  matrix  whose  only  nonzero  entry  is  in  position  (i,  j),  or  as 

xHMHGx  =  xHGMHx  for  all  G  E  {block  diag(6Tr,  0)} 

where  Gkr  ranges  over  the  set  of  all  kr  X  kr  complex  matrices  or  equivalently  over  the 
set  of  all  kr  x  kr  Hermitian  matrices  (as  any  complex  matrix  M  can  be  decomposed  as 
M  —  Mi  +  jM2,  with  Mi,  Hermitian). 

2.2  General  Case 

It  is  x'eadily  checked  that  repeated  complex  scalar  blocks  ( mc  >  0)  imply  constraints 
of  the  form  (to  be  compared  with  (2.6)  above) 

( Mx)i  (Mx)j 

Xi  Xj 

with  i  and  j  ranging  over  indices  corresponding  to  the  block  under  consideration.  With 
this  in  mind,  extension  to  the  case  of  a  general  block  structure  presents  mostly  notational 
rather  than  conceptual  difficulty.  Consider  the  projection  matrices  Qq,  q  =  1,...,  m, 
defined  by 

Qq  —  block  rOW  (Ofc5  xki  1  •  •  •  1  Okqxkq_i  5  Ikq  5  Okq  Xkq 4.1  j  ■  •  ■  1  Okqxkm )  , 
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where,  for  any  positive  integers  k,  k Ok  is  the  k  x  k  zero  matrix  and  Okxk'  is  the  k  x  k1 
zero  matrix.  Also,  for  q  =  1, . . . ,  mr  +  mc,  consider  the  index  set  Jq  defined  by 

{9-1  9-1  9 

'y  ^  kp  +  1,  y  ]  kp  +  2, . . . ,  ^  '  kp 

p=i  p= l  p=i 

The  result  obtained  in  Subsection  2.1  is  then  generalized  as  follows  (see  proof  in  Appendix 
A). 

Theorem  2.1.  For  any  matrix  M  and  associated  structure  Af, 


MM)  =  • 

[° 

(  max{# 

with 

Sk(M ) 

if  Sk{M) 

otherwise 

(2.7) 


E  dB  :  xi(Mx)j  =  Xj(Mx)i ,  (i,j)  E  (J  Jq  x  Jq\ 

9=1 

mr  +  mc  'l 

Vi(Mx)j  =  Xj(Mx)i,  ( i,j )  G  [J  Jq  X  >. 

3=mr  +  l  J 


n 


Formula  (2.7)  for  )  amounts  to  a  constrained  maximization  over  6  and  x  in 

IR  X  Cn.  It  has  some  definite  computational  advantages  over  the  formula  defining  /i/c(M) 
in  Definition  1.1.  The  number  of  variables  is  limited,  the  objective  and  constraints  are 
inexpensive  to  evaluate  and,  after  squaring  all  the  norms,  objective  and  constraints  become 
smooth.  However,  again,  (2.7)  may  have  local  maxima  which  are  not  global  and  it  is  not 
clear  whether  the  global  maximum  can  be  easily  obtained. 


Remark  2.1.  Finding  a  point  x  E  S/c(M)  may  not  always  be  simple.  Yet,  in  the  following 
two  cases,  such  a  point  is  readily  available:  (i)  if  me  >  0  then  x  E  <S/c(M)  whenever 
1 1 a. j |  —  1  and  xt  =  0  for  all  *  E  Jq,  q  —  1, . . . ,  mr  +  mc;  (ii)  if  M  has  a  real  eigenvalue,  then 
x  E  S/c(M )  with  x  any  corresponding  unit  length  eigenvector.  □ 

Remark  2.2.  It  should  be  clear  that  in  the  purely  real  case,  i.e.,  when  M  is  a  real  matrix 
matrix  and  mc  =  me  =  0,  (2.7)  still  holds  if  x  is  restricted  to  be  real.  O 

Remark  2.3.  Some  of  the  constraints  defining  Sk(M )  may  seem  to  be  redundant.  In 
fact,  it  can  be  shown  that  expression  (2.7)  is  no  longer  valid  if  any  of  these  constraints 
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is  removed  but  that  for  a  generic  matrix  M  (in  particular,  for  one  with  no  zero  entries), 
roughly  25%  of  the  constraints  are  indeed  redundant.  □ 

Remark  2.4.  Following  [3],  let  us  define  the  spectrum  of  M  with  respect  to  K  as 

s pk(M)  =  {A  e  Xk  :  det(M  —  A)  =  0} 


(  0  if  sp k(M)  -  0 

\  sup  u(A)  otherwise. 

I  A€spx;(M) 


7 jc(M)=  sup  {d:\\QgMx\\=6q\\Qqx\\,dq>d,q  =  l,...,m  for  some  x  G  Sk(M)} 

0>O 

(2.8a) 

if  the  feasible  set  in  (2.8a)  is  nonempty,  and 

7  k(M)  =  0  (2.8b) 

otherwise.  Clearly  (2.8)  is  very  similar  to  (2.7).  Yet,  as  pointed  out  in  [3],  while  7 k(M)  = 
Hic(M)  if  mr  =  0  (no  parametric  uncertainty),  equality  does  not  hold  in  general,  but  rather 


and  let 

7/c(M)  = 

Then  it  is  simple  to  check  that 


7 k(M)  <  nK{M)  . 


(2.9) 


□ 

In  the  case  when  mc  =  0,  Sk{M)  can  be  expressed  in  a  simple  form,  to  be  used  in  the 
following  sections. 

Proposition  2.1.  Let  Q) c  be  the  family  of  Hermitian  matrices 

Qk  =  {block  diagtGh,...,  Gm„,  Ofcmr+1, .  •  • ,  Okm)  :  Gq  =  G»  G 

and  let  6k  be  any  basis  for  Qk-  Then 

Sk(M)  D  {x  €  dB  :  xH(MHG  -GM)x  VG  €  Qk} 

=  {x£dB  :  xh{MhE  -  EM) x  VE  £  6k}- 
If  mc  =  0,  then  Sk(M )  is  equal  to  the  right  hand  side  of  (2.10).  □ 
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3.  Interpretation  in  Terms  of  the  Multiform  Numerical  Range 

Formula  (2.7)  leads  to  a  characterization  of  the  structured  singular  value  in  terms 
of  the  multiform  numerical  range  of  some  matrices.  The  multiform  numerical  range  (or 
t-form  numerical  range )  of  a  t-tuple  of  n  X  n  Hermitian  matrices  Ai,. At  is  the  set 

W(Au...,At)={f(x)  :  xedB} 

where  /:  Cn  — »  1R/  has  components 

fq(x)  =  xH  Aqx,  q  =  1,. . .  ,t  . 

First  suppose  that  mr  —  mc  —  0.  For  »eE,  let 

Aq(o 0  -  aQTqQq  -  MHQTqQqM ,  q=l,...,mc  (3.1) 

and  let  W/c(a)  be  the  mc~ form  numerical  range  W(A\(ct),  . . . ,  Amc(a)).  Then4 

Hk(M)  =  inf  {v^  :  0  ^  WK(<*)  +  1R^C  }  (mr  =  mc  =  0)(3.2) 

a>0 

with 

1R™C  ={ve  Umc  :vq>  0,  9  =  1,...,  me]  . 

This  follows  rather  directly  if  one  rewrites  the  constraints  in  (2.7)  as 

xHAq(02)x  <  0,  q  =  l,...,mc- 

Suppose  now  that  mr  ^  0.  For  q  =  1, . . .  ,m  (m  =  mr  +  me)  and  a  G  IR,  let 

Aq(a)  =  aQjQq  -  MHQTqQqM 

mr 

and  for  i  =  1, . . . ,  k2,  let 

i~  1 

Am+g(a)  =  j(MHEq  -  EqM ) 

where  the  Eq’ s  are  the  elements  of  a  basis  S/c  of  Qk  taken  in  some  arbitrary  order,  and  where 
the  argument  a  is  used  for  the  sake  of  uniformity  of  notation.  Then  Aq(a)  —  Aq(a)H , 
q  =  1, . . . ,  s,  with 

mr 

s  =  mAj2ki  ’ 

i=  1 

4  A  related  result  was  obtained  in  [30]. 
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and  fi)c(M)  =  0  if  Stc(M )  =  0  and 


Hic(M)  —  max  \  \/o  :  xH  Aq(a)x  <0,  q  =  1, . . . ,  m} 

x£dB  ^ 
c«  >  0 

otherwise.  Denoting  by  Wk.{ol)  the  multiform  numerical  range  associated  with  Ai(a),  . . 

As(a),  i.e., 

Wyc{oc)  =  {»£  IRS  :  3x  e  dB  s.t.  vq  =  xH Ag(a)x,  q  =  1, . . . ,  5}, 

we  obtain  the  following  result,  to  be  compared  with  (3.2).  Here  the  set  Vm  C  1RS  is  defined 
by 

Vm  =  jw  €  IR*  :  vq  >  0,q  =  1, . . .  ,m  -,vq  =  0,q  =  m  +  1, . . .  ,  s  j  . 

Theorem  3.1. 

liK{M)  =  inf  :  0  £  WK{<*)  +  Vm}  .  (mc  =  0) 

or>0 

n 

Let  us  now  define,  for  any  a  6  1R, 

c/c(a)  —  min{Ar(u)  :  v  G  Wy c(o)  +  Vm } 


where  iV(-)  is  any  given  norm  in  1RS  satisfying  N(eq)  <  1,  with  {eq}  the  canonical  basis, 
and  let  us  consider  the  following  algorithm. 

Algorithm  3.1.  (Computation  of  p/c(M)  when  mc  =  0) 

Step  0.  Set  no  =  u2(M)  and  k  —  0. 

Step  1.  Set  ak+ 1  =  Oik  -  cyc(ak). 

Step  2.  Set  k  =  k  +  1  and  go  to  Step  1.  Q] 

A  key  property  of  cy <;(•)  (see  [30,31])  still  holds  here  (see  proof  in  Appendix  A). 

Proposition  3.1.  cyc( •)  is  continuous  and,  for  any  >  0  and  a  £  H,  cyc(ot+/3)  <  cyc(oc)+/3. 

□ 

The  following  convergence  result  follows  (see  [30]). 

Theorem  3.2.  The  sequence  {«fc}  generated  by  Algorithm  3.1  is  monotone  nonincreasing 
and 

lim  y /oik  =  l*ic(M)  . 

k—*  00 
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□ 

Algorithm  3.1  can  be  implemented  whenever  Wjc{a)  is  convex.  Since  the  multiform 
numerical  range  of  no  more  than  3  matrices  is  always  convex  (provided  these  matrices  have 
size  at  least  3x3)  [32-34],  this  will  always  be  the  case  when  s  <  3,  i.e.,  in  the  case  of  3 
or  fewer  complex  blocks  (rnr  =  0,mc  =  0 ,mc  <  3)  or  1  real  scalar  block  and  one  or  no 
complex  block  (mr  =  l,Aq  =  1  ,mc  =  0,mc  <  1). 

4.  A  Computable  Upper  Bound 

Given  any  block-structure  XT,  the  corresponding  structured  singular  value  is  no  greater 
than  the  largest  singular  value,  as  the  latter  corresponds  to  the  least  restrictive  structure 
/C  =  (;;n)  (see  (1.3)).  The  following  proposition,  a  consequence  of  Theorem  2.1  and 
Proposition  2.1  (see  proof  in  Appendix  A),  provides  two  intermediate  bounds. 

Proposition  4.1.  For  any  matrix  M  and  associated  block-structure  AC, 

•Abe (M)  <  Vk(M)  <  vK (M)  <  a(M)  ,  (4.1) 


where 


ro  if  sk(m)  = 

i]k(M)  =  <  max  j|Mx||  otherwise 
I  x£S>c(M) 


and 


vk{M)  =  Umax  {  0,  inf  A [MHM+j(GM  -  MHG )] 

GeGtc 


n 


The  following  theorem  is  a  direct  consequence  of  (1.4)  and  Proposition  4.1. 
Theorem  4.1.  For  any  matrix  M  and  associated  block-structure  AC, 


inf  ilK(DMD-l)<  inf  vk,{DMD~1  )  <  inf  ff(Mfl_1)  .  (4.2) 

D£V/c  D£V) c  D(zT>t c 


n 


Theorem  4.1  gives  two  upper  bounds  which  are  less  conservative  than  ^inf  a(DMD  -1). 

However,  since  max  may  have  local  maxima  that  are  not  global, 

x£S/c(DM  D~l) 

attempts  to  evaluate  rjic(DMD~1)  may  yield  strict  lower  bounds  on  this  quantity  and  this 
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may  result  in  underestimation  of  n/c (M).  Fortunately,  the  second  upper  bound  in  (4.2) 
does  not  suffer  from  this  shortcoming.  Indeed,  we  can  write 


M.  MDMD~' >  =  ^ 

where  F  :  T>k  x  Qk  — >  1R  is  defined  by 

F(D,G)  =  A  [Mg Md  +j(GMD-M"G)\  (4.4) 

with  Md  —  DMD^1 .  Thus  for  any  D  £  T>k,  G  £  £bc,  unless  F(D,G )  <  0  (in  which  case 
mc(M)  =  0),  y/F(D,  G)  is  an  upper  bound  for  /i*;(M).  The  same  upper  bound  can  be 
obtained  by  means  of  a  computationally  simpler  problem  as  seen  next.  For  any  a  £  1R  let 
4>a  :  T>jc  x  Qk  — >  H  be  defined  by 


$a(D,G)  =  A [MHDM +j(GM  -  MHG)-aD}.  (4.5) 


Proposition  4.2.  (i)  For  any  D  £  T>k,G  £  Qk, 

F(D,  G)  =  max  {a  :  cj>a(D2,DGD)  >  0), 
aelR 

which  is  the  only  value  a  for  which  $a(Z)2 ,  DGD)  =  0.  (ii)  Moreover 


inf  F(D,  G) 
Devz,Ge0K 


inf  maxla  :  Qa(D,G)  >  0}  . 
D6Vk,G60k  ae]Rl 


□ 

Notice  that  is  the  composition  of  a  convex  function  (A)  and  an  affine  function,  and 
thus  is  convex.  It  can  be  shown  that  any  local  minimizer  (D,  G)  for 


inf  max-fa  :  $a(D,G)  >  0} 
DeVK,G€0K  ae]R 


is  global  and  this  problem  can  be  solved  by  means  of  a  simple  algorithm  [35]. 

Finally,  there  are  noteworthy  instances  where  the  new  upper  bound  is  equal  to  the 
structured  singular  value.  The  next  proportion  establishes  a  sufficient  condition  on  for 
this  to  hold. 
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Proposition  4.3.  Let  (!)*,<?*)  £  V/c  x  and  let 

a*  =  max{a  :  $a(.D*,  (S'*)  >  0}. 

If  is  differentiable  at  (Z>*,  (S*)  with  vanishing  derivative,  then 

)  =  min  vk.(DMD~1)  =  vk(D1J2 MD*1^  — 

Dev*, 

1/2,  ,  .  _ 1  /2  . 

where  D*  is  the  positive  definite  square  root  of  D*  and  D*  '  is  its  inverse.  n 

An  important  case  where  the  conditions  of  Proposition  4.3  hold  is  as  follows. 

Theorem  4.2.  Suppose  that  inf  F(D ,  (?)  is  achieved,  say  at  ( D ,  G ),  and  that  the 

D£Vtc,GG.6>c 

corresponding  largest  eigenvalue  in  (4.4)  is  simple.  Then 
p/c(M)  =  inf  uk(DMD~1)  =  uk(DMD~ x)  = 

D£V)c 


5.  Correspondence  with  the  Linear  Fractional  Transformation  Approach 

In  [3],  it  is  shown  that  in  the  case  of  nonrepeated  real  scalar  blocks  ( kq  =  1,  q  = 
1, . . .  ,mr),  given  a  >  0,  a  sufficient  condition  to  insure  that  /j,jc(M)  <  a  is  that, 

inf  inf  a\jC +  (I -C2)1I2d(—\d-1\  <1  (5.1) 

D£Vk  C€Ck  L  J\aJ 

where 

Ck  =  {diag(c1,c2,...,cTOr,0,...,0)  :  a  £  (-1,1)}  • 

Using  the  bijection  from  (—1,1)  to  1R 


c  h-»  g 


'1  -  c2 


it  is  easily  checked  that  condition  (5.1)  is  equivalent  to 


inf  inf  cr  \(d(— ^D-1  +jG)(I  +  G2)~1/2}  <1 
DePjc  G€Gk:  [  \  a  ) 


The  following  proposition,  which  holds  whether  or  not  there  are  repeated  scalar  blocks, 
connects  (5.2)  with  (4.3). 
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Proposition  5.1.  Let  a  >  0.  Then  (5.2)  holds  if,  and  only  if, 

inf  inf  F(D,G )  <  a2  .  (5.3) 

Dev^GeGK 

Moreover,  the  infimum  is  achieved  in  (5.2)  if,  and  only  if,  it  is  achieved  in  (5.3).  |~1 
Thus,  (5.1)  implies  fifc(M)  <  a  in  the  general  case,  provided  Ck.  consists  now  of  Hermitian 
block  diagonal  matrices  in  the  place  of  the  scalars,  and  the  infimum  of  all  positive  o’s 
satisfying  (5.1)  is  identical  to  the  second  upper  bound  in  (4.3).  The  advantage  of  (4.3)  is 
that  it  has  much  better  computational  properties.  The  characterizations  in  (5.1)  and  (5.2) 
may  still  be  useful  in  the  context  of  //-synthesis,  which  uses  the  upper  bounds  and  H oo 
optimal  control  to  synthesize  controllers.  This  is  under  investigation. 

6.  Examples 

The  main  result  of  this  paper  is  that  obtained  in  Section  4  of  a  computable  upper 
bound  to  the  structured  singular  value  with  respect  to  a  structure  involving  both  complex 
blocks  and  real  scalars.  It  was  pointed  out  that  the  new  bound  is  in  general  sharper  than 
that  of  formula  (1.5)  corresponding  to  the  assumption  that  all  uncertainties  are  allowed 
to  take  on  complex  values.  The  purpose  of  the  numerical  experiments  reported  here  is  to 
illustrate  this  last  statement. 

We  begin  with  an  example  that  can  be  given  some  engineering  motivation.  Although 
a  complete  tutorial  on  the  use  of  \x  in  analyzing  control  systems  is  beyond  the  scope  of 
this  paper,  this  example  illustrates  some  of  the  key  issues.  Also,  it  is  an  example  where 
the  correct  answer  for  real  perturbations  is  known,  so  we  can  compare  this  with  what  is 
obtained  using  the  methods  of  this  paper.  We  begin  with  the  transfer  function  model 

/  ,  _  OtiUiS 

3  6  “  s2  +  2(jU )iS  +  w?(l  +  riSi) 

with  op  cap  r,  and  ( ;  all  positive  constants,  and  the  Si  representing  real  perturbations 
which  have  been  normalized  such  that  —  1  <  Si  <  1. 

Several  different  physical  problems  could  motivate  a  model  of  this  type.  A  mechanical 
system  consisting  of  an  interconnection  of  n  masses  and  springs  would  be  the  simplest 
example.  Uncertainty  in  the  value  of  the  spring  constants  would  lead  naturally  to  per¬ 
turbations  entering  in  this  way.  A  very  similar  problem  would  be  the  first  n  modes  of 
a  flexible  structure  with  uncertainty  in  the  stiffness  of  the  materials.  In  either  case  the 
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numerator  dynamics  are  consistent  with  the  assumption  that  the  control  input  is  a  force 
and  the  output  is  a  velocity  measurement  at  the  same  location  as  the  force  input.  In  the 
flexible  structure  literature  this  is  referred  to  as  a  collocated  sensor  and  actuator.  If  this 
were  a  model  of  a  flexible  structure  to  be  used  in  control  design,  we  might  want  to  consider 
uncertainty  in  the  damping  as  well,  and  would  probably  add  additional  perturbations  to 
cover  unmodeled  modes. 

Another  way  that  an  uncertainty  description  like  the  one  above  could  naturally  arise 
is  when  the  do  not  represent  any  particular  known  physical  mechanism,  but  are  used 
to  capture  the  regularities  that  might  be  found  in  input-output  data.  In  any  case,  it  is 
important  to  recognize  that,  strictly  speaking,  parameters  and  perturbations  are  mathe¬ 
matical  objects  that  occur  in  our  models,  not  in  the  physical  systems  being  modeled.  We 
use  explicit  representations  of  uncertainty  because  we  want  models  which  are  useful  for 
control  design,  but  coming  up  with  such  models  for  actual  physical  systems  can  often  be 
quite  challenging.  For  this  example,  we’ll  take  n  =  3,  u)\  —  .5,  u2  =  1,  u>3  =  2,  and 
C i  —  .01,  oti  —  .2,  r-i  =  1  for  all  i.  This  would  correspond  to  a  fairly  lightly  damped  system. 

Suppose  we  use  a  unity  feedback  system  with  a  disturbance  occurring  at  the  same 
location  as  the  force  input.  Then  denoting  the  output  by  ?/,  the  input  by  u,  and  the 
disturbance  by  d,  we  get 

y(s)  =w0)0(s)  +  d(s)) 


u(s)  =  -y(s) 


Suppose  we  are  interested  in  internal  stability  of  this  feedback  system  as  the  Si  vary.  It  is 
easily  verified  by  examining  the  Nyquist  plot  for  g  that 

(i)  the  system  is  stable  if,  and  only  if  Si  >  —1  for  all  i ;  if  for  any  i,  Si  =  —1  then  the 
system  has  an  open  loop  pole-zero  cancellation  at  s  =  0  and  cannot  be  stabilized. 

(ii)  the  magnitude  (in  the  sense)  of  the  closed  loop  transfer  function  from  d  to  y  is 
less  than  1  for  all  s  =  ju:  if  Sz  >  —  1  for  all  i. 

To  apply  the  methods  in  this  paper  it  is  necessary  to  obtain  the  interconnection 
structure  of  Figure  1  with 


H(s)  = 


Hn(s) 

H2i(s) 


H12(s) 

H22{s) 


=  CisI-Ay'B  , 
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where  Hu(s),  #12(5),  #21  (s),  and  #22(3)  are  3  X  3,  3  X  1,  1  X  3,  and  lxl,  respectively, 


and  where 
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0.00  0.00 

0.00  1 

-0.25 

-0.11 

0.00 

-0.20  0.00 

— 

0.40 

0.00 

0.00 

0.00 

1.00  0.00 

0.00 

0.00 

-0.10 

-1.00 

-0.22  0.00 

— 

0.40 

0.00 

0.00 

0.00 

0.00  0.00 

1.00 

_  0.00 

-0.10 

0.00 

-0.20  -4.00 

— 

0.44  J 

-  0.00 

0.00 

0.00  0.00- 

-0.25 

0.00 

0.00  1.00 

B 

0.00 

0.00 

0.00  0.00 

0.00 

-1.00 

0.00  1.00 

9 

0.00 

0.00 

0.00  0.00 

.  0.00 

0.00 

-4.00  1.00. 

-1.00  0.00 

0.00 

0.00  0.00  0.00- 

C  = 

0.00  0.00 

1.00 

0.00  0.00  0.00 

0.00  0.00 

0.00 

0.00  1.00  0.00 

* 

.0.00  0.10 

0.00 

0.20  0.00  0.40. 

Computation  of  A,  B  and  C  is  tedious  but  straightforward,  and  easily  done  by  computer. 
For  a  discussion  of  how  to  obtain  these  interconnection  structures  for  general  problems, 
see,  for  example  [36]. 

Concerning  the  robust  stability  question,  the  Small  fi  Theorem  [2]  asserts  that,  for 
given  8  >  0,  the  system  in  Figure  1  is  stable  for  all  <5;  satisfying  —  8  <  Si  <  8  if,  and  only 

if, 


sup/i/c(Ffii(jca))  <  1/8 

U> 

with  the  block-structure  AC  =  (1,1,1;;).  In  view  of  (?)  in  the  foregoing  discussion,  it  follows 

that 


sup  /ijc(i?u  (jo;))  =  1  .  (6.1) 

LO 

Computation  of  inf deVk.  v>c(DHi\(ju)D~l)  using  the  algorithm  of  [35]  reveals  that 


=  [I’, 


Theorem  4.1  together  with  (6.1)  thus  implies  that 
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1,  if  uj  =  0  ; 
0,  if  lo  ±  0  . 


(Note  that  the  upper  bound  is  thus  exact  at  all  frequencies.)  This  example  illustrates  that  if 
mr  7^  0,  then  hk.(M )  is  not  necessarily  a  continuous  function  of  M.  As  seen  on  Figure  2,  it 
also  illustrates  that  the  “complex”  upper  bound,5  corresponding  to  the  structure  (;;  1,1,1), 
can  be  quite  poor  an  estimate  of  the  “real”  structured  singular  value. 

The  Small  fi  Theorem  also  gives  a  precise  characterization  of  robust  performance. 
Namely,  the  system  in  Figure  1  is  stable  for  all  8t  satisfying  —8  <  8{  <  8  and  the  worst- 
case  performance  (i.e.,  the  worst-case  Hoo  gain  from  d  to  y )  is  strictly  less  than  8  if,  and 
only  if, 

SUP  Hc(h (Ju))  <  1/8 

LJ 

with  the  augmented  block-structure  K,  =  (1, 1, 1; ;  1).  In  view  of  (i)  and  (ii)  in  the  discus¬ 
sion  above,  it  follows  that 

sup  Hit(H(ju))  =  1  . 

U> 

The  results  of  computation  of  infDgp^  for  u  >  0  using  the  algorithm 

of  [35]  are  plotted  in  Figure  3.  Again  it  is  seen  that  the  supremum  over  frequency  of 
this  upper  bound  is  identical  to  that  of  the  structured  singular  value.6  For  comparison,  a 
plot  of  the  “complex”  upper  bound,  corresponding  to  the  structure  (;;1, 1,1,1),  is  shown  in 
Figure  4. 

The  final  examples  involve  square  transfer  matrices  H(s)  =  C(sl  —  A)~1  B  +  E  of 
dimension  2x2  and  5x5  and  with  A,  B ,  C  and  E  generated  randomly.  We  computed  the 
upper  bound  to  y,ic(H(juj))  obtained  in  Section  4  on  a  grid  of  values  of  lo  (logarithmically 
spaced,  with  20  points  per  decade)  for  the  following  structures  /C,  all  consisting  of  scalar 
blocks  only:  (i)  all  scalars  are  allowed  to  take  on  complex  values,  (ii)  some  of  the  scalars  are 
restricted  to  be  real,  and  (Hi)  all  the  scalars  are  restricted  to  be  real.  In  the  2x2  case  (two 
scalar  blocks)  the  structured  singular  value  in  case  ( in )  was  also  computed  exactly  (it  can 
be  evaluated  by  finding  the  roots  of  a  system  of  two  bilinear  equations  in  two  variables).  A 
typical  sample  of  the  results  we  obtained  is  displayed  in  Figures  5  to  17.  The  four  curves 
in  Figures  5  to  14  correspond  (top  to  bottom)  to  structures  (; ;  1 ,1 ) ,  (1;;1),  and  (1,1;;)  (for 

5  equal  to  the  SSV  in  this  three  block  case 

6  Computation  of  fi^(H(ju>))  for  all  u>  was  not  attempted  as  it  requires,  for  each 
frequency,  computation  of  the  global  maximum  of  a  constrained  optimization  problem  of 
the  form  (2.7). 
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the  bottom  two  curves)  respectively.7  In  Figures  15  to  17,  the  three  curves  correspond  to 
structures  (;;1,1,1,1,1),  (1,1;;1,1,1),  and  (1,1, 1,1,1;;),  respectively.  For  validation  purposes, 
the  matrices  corresponding  to  Figures  5  and  15  are  given  in  Appendix  B. 

Clearly,  in  most  cases,  the  upper  bound  derived  in  Section  4  is  significantly  less  conser¬ 
vative  than  that  obtained  by  assuming  possibly  complex  uncertainty.  Note  that  in  many 
cases  (Figures  5,  7,  8,  10,  13)  the  maximum  over  frequency  of  the  new  upper  bound  is 
essentially  identical  to  the  maximum  over  frequency  of  the  exact  structured  singular  value. 
7.  Future  research 

The  main  result  of  this  paper  is  the  computable  upper  bound  in  (4.5)  for  fi  with  struc¬ 
tures  having  both  real  and  complex  blocks.  While  this  yields  a  tremendous  improvement 
over  the  upper  bound  in  (1.5),  it  still  does  not  give  an  exact  method  for  computing  p.  A 
lower  bound  for  [i  can  be  found  from  (2.7)  by  local  search,8  but  since  (2.7)  may  have  local 
maxima  which  are  not  global  this  may  not  yield  p.  It  would  be  reasonably  inexpensive 
to  compute  these  two  bounds  and,  obviously,  \jl  would  be  between  them.  However,  it  is 
possible  that  the  bounds  could  be  far  apart. 

What  are  the  prospects  for  a  general,  exact,  computationally  attractive  method  for 
computing  /i  for  real  perturbations?  One  promising  possibility  is  suggested  by  a  research 
direction  initiated  by  de  Gaston  [6-8].  This  work  begins  with  an  upper  and  lower  bound 
which  may  also  be  far  apart.  The  bounds  are  refined,  however,  by  partitioning  the  domain 
of  the  perturbations  and  computing  the  bounds  for  subdomains.  While  the  growth  of  this 
tree  of  subdomains  can  be  exponential,  it  is  conjectured  that  the  number  of  subdomains  can 
be  kept  manageable  by  standard  tree-pruning  involving  comparing  the  bounds  of  different 
domains.  Unfortunately,  the  bounds  themselves  have  exponential  explosion.  A  promising 
research  direction  is  to  combine  a  subdomain  partitioning  scheme  with  the  bounds  in  this 
paper.  This  would  eliminate  the  exponential  explosion  in  the  computation  of  the  bounds. 
Then  the  critical  issue  would  be  the  growth  in  the  number  of  subdomains  on  which  the 
bounds  would  be  computed.  If  a  scheme  could  be  found  to  keep  this  growth  manageable, 
it  would  lead  to  the  desired  efficient,  general,  exact  method  of  computing  f.t.  This  idea  is 
currently  under  investigation. 

Acknowledgements 

7  On  Figure  7,  the  bottom  two  curves  coincide 

8  provided  a  feasible  point  is  available 
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Appendix  A. 

The  following  lemma  is  used  in  the  proof  of  Theorem  2.1  below. 

Lemma  A.  Let  8  >  0,  x  £  Cn,  and  let  q  £  {1, . . . ,  mr  +  mc}.  Suppose  that 

\\Q,Ux\\  >  e\\Q,x\\  .  (A.1) 


Then  (i) 

Xi(Mx)j  ="Xj(Mx)i,  i,j  6  Jq  (A. 2) 

if,  and  only  if,  for  some  6  £  [—1,1], 


8(Mx)i  =  8xi,  i  £  Jq 


(A3) 


and  (ii) 


Xi(Mx)j  =  Xj(Mx)i,  i,j  £  Jq 


if,  and  only  if,  (A. 3)  holds  for  some  6  £  C,  |<5|  <  1. 


(-4-4) 


Proof.  We  prove  the  first  equivalence  (the  second  one  follows  similarly).  First  suppose 
(A. 2)  holds.  If  ( Mx)i  =  0  for  all  i  £  Jq  then,  in  view  of  (A.l),  aq  =  0  for  all  i  £  Jq,  so  that 
(A. 3)  holds  with  any  8.  Suppose  now  that  ( Mx)i0  ^  0  for  some  «o  £  Jq  and  let 


8  = 


(A.5) 


Let  i  £  Jq.  If  ( Mx)i  =  0  then  it  follows  from  (A. 2)  with  ( i,j )  =  (i,io)  that  Xi  =  0,  so  that 
(A. 3)  holds  for  i.  If  ( Mx)i  ^  0,  then  using  (A. 2)  with  (i,j)  successively  equal  to  (i,io) 
and  (z'o,?o),  then  (A. 5),  one  gets 

Oxj _ tfabo _ ^ 

(Mx)i  (Mx)l0  ~  ( Mx)io 
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so  that,  again,  (A. 3)  holds  for  i.  To  prove  the  converse,  suppose  now  that  (A. 3)  holds. 
Let  i  E  Jq.  If  ( Mx)i  =  0  then  (A. 3)  implies  that  Xi  =  0,  so  that  (A. 2)  holds  for  i  and  any 
j  E  Jq.  Finally,  for  any  (i,j)  such  that  ( Mx)i  ^  0  ^  ( Mx)j ,  (A. 3)  yields,  since  8  is  real 

Bx{  6xj  9xj 

( Mx)i  (Mx)j  ( Mx)j 

so  that  (A. 2)  holds.  [~1 

Proof  of  Theorem  2.1.  Let  Jlk(M)  denote  the  right  hand  side  in  (2.7).  We  first  show 
that  fi)c(M)  >  7 If  S)c(M)  =  0,  it  holds  trivially.  Otherwise,  the  feasible  set  for 
(2.7)  is  nonempty.  Thus  let  ( 9,x )  be  feasible  for  (2.7).  We  show  that  )  >  6,  which 

establishes  the  claim.  If  9  =  0  this  holds  trivially.  Thus  assume  9  >  0.  In  view  of  Lemma 
A,  there  exists  8rq  E  [—1,1],  q  =  1, . . . ,  mr,  8q  E  €,  <  1,  q  =  1, . . . ,  mc,  such  that 

Srq(Mx)i  =  9Xi  Vie  Jq 

and,  for  q  =  1, . . .  ,  mc, 

8q(Mx)i  =  9xi  V  i  e  Jmr+q 

i.e., 

8qQqMx  =  9Qqx ,  5  =  1,..., mr  , 

9qQmr-\-qM X  =  9Q rrirJrqX ^  q  —  1, . . . ,  mc  . 

Feasibility  of  (9,x)  for  (2.7)  also  implies  that  there  exists  E  Cfcmr+mc+?xfcm’-+mc+9, 
u( )  <  1,  such  that 

Qmr+mc|g AJx  —  ^Qnjr4-mc+j^)  =  I5  •  •  •  )  • 


Thus,  the  matrix 


A  =  -Q  block  diag  [8\lkx , . . . ,  Cr  hmr ,  ^I*mr+1 ,  •  •  • ,  ScmcIkmr+mc ,  A? , . . . ,  Agc) 


is  such  that  A  E  Aye,  <7(A)  <  and  A Mx  =  x.  The  latter  implies  that  det(J— AM)  =  0, 
so  that  f.i)c(M)  >  9.  Conversely,  let  us  now  show  that  mc(M)  <  Ji K(M).  If  f/,/c(M)  —  0, 
it  holds  trivially.  Thus  suppose  fj,/c(M)  >  0.  Let  8  =  yu^1( M ).  By  definition  of  fifc(M), 
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there  exists  8rq  G  1R,  5  =  1  8°  G  C,  5  =  A^7  G  <pfc™,.+mc-H xfcmr+mc+^ 


5  =  1,...,  me,  with 

Kl  <  !,  5  =  1,. 

(A. 6a) 

1^1  <  1,  5  =  l,..-,mc  , 

(AM) 

^(Aj7)  <  1  5  =  1,..., mc, 

such  that 

(A. 6c) 

A  =  «  block  diag  («[/», , . . . ,  ,  ifl4mr+1 .....  6cmJkmr^ ,  Af , . . . 

satisfies  det(/  —  AM)  =  0,  i.e.,  for  some  x  G  cb3, 

,A  Zc)eXK(6) 

AMx  =  x  . 

(A.7) 

We  show  that  (6  1 ,  x)  is  feasible  for  (2.7),  thus  completing  the  proof.  From  (A. 7)  it  follows 

that 

8rqQqMx  =  -Qqx,  5  =  1,..., mr  , 

(A. 8a) 

8qQmr  +  qMx  =  —Qmr  +  gX,  q  =  1,  .  .  .  ,  TTlc  , 

(A. 86) 

Ag  Q  mT  +  mc-\-qMx  =  —  Qmr-f  mc-f  5  =  1,  •  •  •  ,  mC  • 

In  view  of  Lemma  A,  it  follows  from  (A. 8)  that,  for  5  =  1, . . . ,  mr 

Xi(Mx)j  =  Xj(Mx)i  V  i,j  G  Jq 

and,  for  5  =  1,...,  mc 

Xi(Mx)j  —  x  j(J\/Ix)i  V  G  7 mr+} 

(A.9) 

and  thus,  x  G  S/c(M).  Finally,  (A. 6),  (A. 8),  and  (A. 9)  imply  that,  for  5 

\\QqMx\\  >  ^||Qgx||  . 

□ 

Proof  of  Proposition  3.1.  Defining  <p  :  dB  x  1R  — >  IRS  by 

<Pi(x,a)  =  xH  Ai(a)x  i  =  l,...,s, 

=  1,...  ,m, 
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one  has,  for  any  real  a, 


c(a)  =  min{N(ip(x,  a)  -f  v)  :  x  £  dB,  v  £  Vm}  . 


Since,  when  a  varies  locally  around  any  given  &  and  x  varies  over  dB ,  tp(x,  a )  is  bounded,  it 
is  clear  that,  for  a  around  a,  v  can  be  restricted  to  lie  in  some  compact  subset  V(&)  of  Vrn- 
Continuity  of  c(-)  at  a  then  follows  from  continuity  of  and  compactness  of  dB  x  V(a). 
Now,  let  /3  >  0  and  a  £  M.  From  the  definition  of  Ai(a),  i  =  1, . . . ,  s,  it  follows  that,  for 
any  x  £  dB , 

<p(x,  «  +  /?)  =  <p(x,  a)  +  f3Q(x) 


where  Q(x )  £  IRS  is  given  by 


Q(x)  = 


\\Q 


xx 


|2  i 


IIQm^H2 

0 


Thus  we  have 

c(a  +  /?)  =  min  N(<p(x,  a  +  fl)  +  v) 

x  £  dB 

ve'T’m 

=  min  N(ip(x,a)  +  v  +  (3Q(x))  . 

v£Vm 

Using  the  triangle  inequality  we  obtain,  since  (3  >  0 


c(a  +  /?)  <  min  [N(tp(x,  a)  +  v)  +  (3 N(Q(x))]  . 
Since  the  norm  N  satisfies  N(eq)  <  1,  we  have,  for  x  £  dB 

m  m 

HQ(*))  <  5>(||Q,z||2e„)  <  ^IIO^H2  =  1 

q=l  ?= 1 

and  thus 

c(a  +  ft)  <  min  [N(<p(x,  a)  +  a)  +  f3\  =  c(a)  +  (3  . 

n 
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Proof  of  Proposition  4.1.  The  first  inequality  holds  trivially  if  S/c(M)  =  0.  If  not,  sup¬ 
pose  that  ( *)  solves  (2.7).  Then,  for  q  =  1  ||QgMx*||  >  fj,jc(M)\\Qqx*\\, 

so  that 

m  m 

II Mi.  ||2  =  J2  II Q,Mx.  ||2  || Q,x,  ||2  =  A(M)  . 

q- 1  9=1 

Since  x*  G  this  first  inequality  in  (4.1)  holds.  The  second  inequality  also  holds 

trivially  if  S/c(M)  —  0.  If  S/c(M )  /  0,  then,  in  view  of  Proposition  2.1,  for  any  x  G  <S/c(M), 

g  g  g, c, 

||Mx||2  =  xhMhMx  =  xh[MhM  +  j(GM  -  MhG))x  <  \[MH M  +  j(GM  -  MHG )] 
and  thus 

Vk(M)=  max  ||Mx||2 

x£Sk:(M) 

<  inf  A [Mh  M +j{GM  -  MhG)} 

GeGic 

<max{0,  inf  \[MH M  +  j(GM  -  MHG)}} 

G£Gk 

=  ul(M). 

Finally,  the  last  inequality  in  (4.1)  is  clear  since  Qx  contains  the  zero  matrix  and  since 

a2(M)  =  A (MhM).  □ 

Proof  of  Proposition  4.2.  First,  (4.4)  can  be  rewritten  as 

F(D,  G)  =  max { a  :  A [M% MD  +  j{GMD  -  M%  G)  -  al]  >  0} 
aelR 

=  max  {a  :  A  [D~1MHD2MD~1  +  j(GDMD~1  -  D~l  MH  DG)  -  al }  >  0}  . 
aelR 

Next,  since  every  D  G  V/c  is  nonsingular,  it  follows  that 

F(D,  G)  =  max {ce  :  A [MHD2M  +j(DGDM  -  MH DGD)  -  aD2}  >  0}  . 
aelR 

=  max{«  :  4>a(£)2 , DGD)  >  0). 
aelR 

Also,  for  given  (D,  G)  G  T>/c  x  Q/c,  since  D  >  0,  $a(D,  G)  is  strictly  decreasing  as  a  function 
of  a.  Thus  (i)  holds.  Claim  (ii)  follows  from  the  fact  that  the  map  Vic  x  Qx  — >  V/c  x  Qx 
defined  by  ( D ,  G)  n >  (D2  ,.DGD)  is  a  bijection.  □ 

Proof  of  Proposition  4.3.  From  the  fact  that  the  derivative  a  at  (D*,G*)  exists 
and  vanishes,  it  follows  that,  for  any  D  G  Vx-,G  G  Qk-, 

A [Mh(D*  +  tD)M  +j(G*M  -  MhG *)  -  «*(£>*  +  tD)}  =  0 
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and 


jl [MHD«M  +j((G*  +  tG)M  -  MH(G*  +  tG))  -  «*!?*] 


=  0. 


t= o 


Using  a  classical  result  on  derivatives  (or  generalized  gradient)  of  eigenvalues  of  Hermitian 
matrices  (see  e.g.,  [37]),  we  may  rewrite  these  two  equalities  as 


x^~[Mh(D,  +tD)M  +j(G*M  -  MhG*)  -a*(D*  +tD)\ 


x*  =  0  (A.10) 


t= o 


and 


xf ~[MhD,M  +  j((G*  +  tG)M  -  Mh(G *  +  tG))  - 


x*  =  0  (All) 


t=o 


where  x*  is  any  unit  length  eigenvector  corresponding  to  the  largest  eigenvalue  of 


MhD*M  +  j(G*M  -MhG*)~  a*D 


h, 


(A. 10)  and  (A. 11)  yield  respectively 

x?(MhDM  -«*£>)x*  =  0 


(A.12) 


and 

x*(GM  -MhG)x*  =  0.  (A. 13) 

Since  D  £  'D/c  is  arbitrary,  (A. 12)  implies  that 

\\QqMx*\\2  =  a*\\Qqx*\\2,  5  =  l,...,m  (A. 14) 

and,  since  G  £  ty/c  is  also  arbitrary,  together  with  (A. 13)  this  implies  that  (x*,y/oZ)  is 
feasible  for  (2.7)  (note  that  (A. 14)  implies  that  a*  is  nonnegative).  Thus  y/aZ  < 

On  the  other  hand,  in  view  of  Proposition  4.2  (ii),  the  definition  of  a*  implies  that 


a*  >  inf  F(D,G) 

D&Vk,G£Gk: 

and  it  follows  from  (4.2)  and  (4.3)  that  y/aZ  >  Thus  y/aZ  —  yu  /c  ( A  A ) .  The  claim 

then  follows  from  Proposition  4.2  (i). 
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Proof  of  Theorem  4.2.  Let  (D*,  G*)  be  a  minimizer  for  F(D,  G )  and  let  a*  =  F(D* ,  G*). 
Since  the  largest  eigenvalue  of  +  j(G*Mz)t  —  M^G*))  is  simple,  we  have 

rank  +  jiG^Mjj^  +  Af^G*))  =  n  —  1 

Given  Z}*  >  0,  this  implies  that 

rank  (MH D\M  +  j(D*G*D*M  -  Mu D*G*DV)  -  aD *)  =  n  -  1.  (A. 15) 


On  the  other  hand,  in  view  of  Proposition  4.2  (i), 


$a,(Dl,D,G,D,)  =  0. 


(A. 16) 


It  follows  from  (4.5),  (A. 15)  and  (A. 16)  that  the  largest  eigenvalue  of  the  matrice  in 
(A. 15)  is  simple  and  thus  Ta<,  is  differentiable  at  (D2 , D*G*.D*).  Since  (D*,G*)  mini¬ 
mizes  F(D,  G )  it  follows  from  Proposition  4.2  (i)  that  the  derivative  of  $Q,  vanishes  at 
(Dl,D*G*D*).  The  claim  then  follows  from  Proposition  4.3. 


Proof  of  Proposition  5.1.  We  show  that  (5.2)  holds  and  the  infimum  in  (5.2)  is  achieved 
if,  and  only  if,  (5.3)  holds  and  the  infimum  in  (5.3)  is  achieved.  Extension  to  the  case  when 
the  infima  are  not  achieved  is  left  as  a  simple  exercise.  Specifically  we  show  that,  given 


D  £  22/c,  G  £  Qk.1 


a 


+  jG)(I  +  G2)~1/2 


<  1 


if,  and  only  if, 


F(D,aG)  <  a2  , 


(note  that  G  £  Q/c  if,  and  only  if,  aG  £  Qk)-  This  equivalence  follows  from  the  following 
sequence  of  equivalent  inequalities,  where  the  notation  Mjj  =  DMD~ 1  is  used: 


(D^W1  +jG)(I  +  G2)~1/2 


<1  , 


(D  (^j  D-1  +  jG){I  +  G'2)-1/2  (D  (^pj  D-1  +  jG){I  +  G2)-1/2  <  J  , 


H 


M 


<  I  +  G2  , 
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n 


H 


+  jG ) 


KC>b"1+jG) 


-G2  <1  , 


\{MgMD+j((aG)MD  -  Mg(aG)))  <  I  , 
or 

A(MgMD+j((aG)MD  -  Mg(aG)))  <  a2  . 


Appendix  B. 

The  A,  .B,  C,  E  matrices  that  were  used  to  generated  Figures  5  and  15  are  as  follows. 
For  Figure  5, 


' -8.0902  x  10~2 

1.2686  x  lO”1 

-3.5762  x  lO'1  - 

-4.8575  x  10“2 

-3.7808  x  10- 

1.8962  x  10-1 

4.1289  x  10-1 

6.1862  x  10-1 

1.0322  x  lO"1 

7.7984  x  10"1 

-4.8243  x  lO"1 

4.1642  x  lO”1 

2.4450  x  lO”1 

-5.6185  x  lO-1 

-4.8248  x  10- 

-1.8448  x  10-3 

2.4564  x  10-1 

-6.5441  x  10“2 

6.7149  x  lO"1 

-5.2891  x  10“ 

.  7.1872  x  lO”2 

-3.3682  x  10-1 

1.2945  x  lO”1 

5.4038  x  lO"1 

-4.4566  x  10“ 

r  2.2105  x  10 

“2  -1.4448  x  10 

_1 1 

B  = 


-4.3877  x  1(T2 
-8.3498  x  KT1 
-1.4370  x  10"1 
1.8585  x  10-1 


4.2382  x  10-1 
3.9127  x  10-1 
2.4036  x  10"1 
-1.7599  x  10-1 


-5.0249  x  10~2  2.3438  x  10“3  6.4024  x  10-1  -1.8836  x  10"1 
-3.6293  x  10-1  -2.1268  x  10"1  -2.3698  x  10-1  -6.4769  x  10-1 


-1.3455  x  10-1 
-1.6309  x  10"1 


2.3845  x  lO"1  -8.0438  x  10"1 " 
3.8387  x  lO-1  6.8429  x  lO-1  ’ 


and  for  Figure  15, 


' -4.5509  x  lO-1 

5.3934  x  10-1 

-9.0161  x  10-3 

5.6126  x  lO”1 

2.4023  x  10-1 

-4.9641  x  10-2 

-4.0575  x  10"1 

-3.3601  x  lO”1 

-5.8569  x  lO"1 

-6.1047  x  10“ 

-2.8742  x  10"2 

-2.6343  x  10"2 

2.1769  x  10-2 

1.7907  x  10-1 

7.2380  x  10-1 

-1.5319  x  lO-1 

2.3885  x  10"1 

-2.7023  x  10"1 

1.9057  x  lO"1 

2.9318  x  10'1 

.  5.2573  x  lO"1 

8.1813  x  10"1 

6.1384  x  10-1 

2.4381  x  10“2 

4.9339  x  lO-1 

--2.6256  x  10-1 

2.5961  x  lO-1 

8.8551  x  10"1 

-6.4732  x  10-2 

6.3857  x  lO"2 

5.1035  x  lO"1 

4.8261  x  10-2 

-1.5665  x  10-1 

-4.1377  x  10-1 

2.4904  x  10-1 

-8.7380  x  10-2 

—  1.3578  x  10-2 

-1.8021  x  lO"1 

6.1830  x  lO”1 

7.3116  x  10”1 

-3.7540  x  10-1 

-5.2973  x  10"1 

3.7967  x  10"1 

3.1948  x  10"1 

-3.4212  x  10“ 

.  1.5306  x  lO"1 

-5.9548  x  10-1 

5.1851  x  lO"1 
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3.0709  x  10-1 

1.0449  x  10"1 

- -1.3036  x  10"1 

-6.6165  x  10~2 

4.3862  x  lO-1 

6.6575  x  10-2 

9.5535  x  10-2- 

-6.8446  x  10-1 

-3.0868  x  lO-1 

1.3999  x  lO"1 

-4.5997  x  lO-1 

1.1329  x  lO"1 

c  = 

4.3439  x  lO-1 

3.1450  x  10~2 

-2.2962  x  lO-1 

-5.4526  x  lO-1 

2.3548  x  10-1 

3.9745  x  10-1 

4.0280  x  lO”1 

-3.0315  x  10-1 

7.0834  x  lO"1 

5.4871  x  lO"1 

.-1.0055  x  lO”1 

4.0313  x  10-1 

-3.5256  x  lO"1 

3.9585  x  10“2 

4.4990  x  10~2 . 

'  3.4802  x  10-1 

7.9979  x  10-1 

4.5178  x  lO"1 

-1.5375  x  lO"1 

-2.4380  x  10-1 

-2.8164  x  lO"1 

-1.2299  x  10-1 

6.6314  x  10-1 

-2.6890  x  lO"1 

-1.1213  x  10-1 

E  = 

2.7349  x  lO-1 

-6.7474  x  lO"1 

-4.5236  x  lO"1 

3.7879  x  lO"1 

-5.2324  x  10-1 

-6.7545  x  lO-1 

-3.5034  x  10-1 

3.1562  x  lO"1 

-7.0583  x  10-1 

3.4941  x  lO"1 

.  2.4558  x  lO"1 

-1.9770  x  10-1 

-1.8149  x  lO-1 

6.9694  x  10-1 

-2.2861  x  lO-1 
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